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Abstract 

Self-organization to ferromagnetic phase transition in cellular automata 
of spins governed by stochastic majority rule and when topology between 
spins is changed, is investigated numerically. Three types of edge rewiring 
are considered. The algorithm of Watts and Strogatz is applied at each 
time step to establish a network evolving stochastically (the first network) . 
The preference functions are defined to amplify the role of strongly con- 
nected vertices (the second network). Demand to preserve graph con- 
nectivity provides the third way of edge rewiring. Each of these pro- 
cesses yields the different network: small-world, scattered nodes with one 
strongly connected component, and scale-free network when rewiring is 
properly adjusted. The stochastic majority rule applied to these networks 
can lead or not to ferromagnetic transition. Classical mean-field transition 
in case of the first and third network is observed. Scale-free ferromagnetic 
transition can be observed when rewiring is properly adjusted. 
Key words: stochastic majority rule, phase transition, small-world net- 
work, scale-free network 



1 Introduction 

From the cellular automata origin - John von Ncumman idea, when studying 
cellular automata what we have in mind there are ways in which cellular au- 
tomata can be used as a tool for understanding the nature. By examining the 
similarities between human and technological systems and their organizations 
the importance of the network effect has been emerged, see for review and 
bibliography. The lesson is that not only design of interactions matter greatly 
in reconstructing nature phenomena but the structure of connections. In par- 
ticular, asymmetry and heterogeneity matter significantly. Therefore the world 

* Corresponding Author E-mail: fizdm@univ.gda.pl 



1 



of cellular automata systems should include the possibility to change the geom- 
etry on the underlying network. The following paper is a proposition in this 
direction. 

For many physical applications, when considering the phenomena where 
many elements interact locally, (i.e., only nearest neighbors interact with each 
other) then it is enough to arrange the elements in the regular way. The basic 
example is the model of localized spins, called Ising model — a toy model for 
ferromagnetic phase transition study |3] . The elements are located in vertices of 
some regular lattice and the interactions are set on static neighborhoods. Many 
cellular automata rules have been designed to simplify (though still represent) 
the Ising interactions. The stochastic majority rule is the standard tool to im- 
itate ferromagnetic interactions in cellular automata because this rule is linear 
approximation to interactions of the Ising model, see Lately, the critical 
phenomena observed in cellular automata with stochastic majority rule have 
been discovered as useful for investigations aimed on understanding dynamical 
properties of the neuropil — the densely interconnected neural tissue structure 
of the cortex [S] . 

Erdos and Reney proposed a model of random arrangement of elements. The 
network is built of N vertices which are connected by an edge with probability 
p. Most features of the resulting network are determined by p, e.g., the average 
degree of a vertex < k >— pN or the mean path between nodes. The degree 
distribution is Poisson distribution what indicates that most nodes have approx- 
imately the same number of links — close to average. The mean path length 
between any two vertices is proportional to the logarithm of the network size. 
This property is known as the small-world property and was discovered when 
networks of social relations were investigated [HI- The investigations of many 
real structures, from natural to artificial origin, ensure that real networks are 
much different from the random network. They are highly non-uniform what 
effects that the degree distribution follows the power-law decay rather than the 
exponential decay. 

The algorithm which transfers a regular lattice into so-called small-world 
was proposed by Watts and Strogatz 7, and is based on rewiring with some 
probability p edges of a regular lattice. However, the distribution of vertex de- 
gree in the Watts-Strogatz network is Gaussian. The Barabasi -Albert recipe for 
constructing a network with the power-law distribution of vertex degree requires 
two ingredients: the growth of the network and the preferential attachment of 
new vertices added to a network at each time step T. 

The Ising model has been studied both analytically and in simulations in the 
small- world topology, EI and in the free-scale topology ^Jj . In both cases 
a change of properties from the regular lattice to the mean-field characteristics 
is observed. Gitterman (9| showed analytically that in the small- world lattice 
the ferromagnetic ordered phase exists and the critical temperature depends 
on parameter p of the small-world topology. A different behavior is observed 
in scale-free network. Here the infinite critical temperature was found in the 
thermodynamic limit of infinite system, |ri| . 

In the following paper we investigate numerically how manipulations with 
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the underlying regular lattice (rewiring and preferential attachment) influence 
the network structure and ferromagnetic properties of cellular automata of spins. 
The changes considered preserve both the number of nodes and the number of 
edges but the network is evolving since the connections between nodes are mod- 
ified each time step. In Section 2 we present the model of cellular automata on 
evolving network. Then, in Section 3, we report results of simulation experi- 
ments aimed on testing critical properties in the system. Section 4 concludes 
our observations and states questions for further investigations. 



2 Cellular automata on evolving network 

Let us consider typical cellular automata with ferromagnetic interactions. It 
means that the basic elements, called spins Ci, are located in nodes of the 
square lattice of linear size L (i G 1, 2, . . . , L^) and each spin is in one of the two 
following states: up [ui — 1) or down {ui = — 1). Each edge is named by two 
numbers which represent nodes connected by the edge. 
The evolution step is two-part: 

(I) — rewiring: each edge (z, fc) sequentially is rewired with probability p: 

(a) independently of the node properties; 

(b) modified by preference to: 

(i) unlink from a node /cth that is weakly connected to the graph: 

= (1) 

deg{k) means degree of fcth node, T - threshold for the preference; 

(ii) link to a node jth that is highly connected to the graph: 

V{J) - ^ (2) 

(c) the preference (i) of (b) is restricted by the demand to preserve con- 
nectivity of the graph. 

(II) — ferromagnetic interaction: the future state of a spin Ui is determined 
by the stochastic majority rule. The rule operates on a present state of 
spins from the nearest-neighbor set Ni{t). Namely, with the probability 
1 -£: 

* ^ ' \ai {t) otherwise 

and with probability e the opposite to Q state is assigned to (Ji{t + 1) (a 
rule makes mistakes with probability e) The ordinary interpretation of a 
stochastic noise is that the noise is the invert of temperature. 
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By this rule the nearest-neighborhoods of nodes are modified in each step asyn- 
chronously while the majority rule is applied synchronously. 

It is known that the stochastic majority rule applied to the regular square 
lattice self-organizes the system to mimic the ferromagnetic phase transition. 
Ferromagnetic features of stationary states depend critically on the value of e 
0]. These critical properties are examined by observing features of the two 
following functions: 

• magnetization — 

m{t) = -lsf^,a,(i) 

• susceptibility — the variance of magnetization. 

The magnetization is expected to change rapidly when the temperature noise 
£ is growing, from non-zero magnetization state to zero-magnetization state. 
When passing the point of change at £crit the variance of magnetization be- 
comes singular in the thermodynamic limit of infinite system. In the finite 
system the point of the critical change is depicted as the narrow maximum 
of susceptibility. The large value of susceptibility denotes that fluctuations of 
magnetization (homogeneous islands of one spin state) of any size are possible. 

By switching on the process of edges rewiring, a regular lattice becomes a 
lattice with long range interactions. Bridges between distant nodes are estab- 
lished. The short-cut links, in general, break isolation of homogeneous islands 
that are present on the lattice due to work of the majority rule. The described 
process should effect both the value of magnetization in the stationary state and 
the point of critical change. 

The simulation experiment goes as follows: starting with all spins up state 
the two-part time step for the fixed probability of rewiring p, fixed procedure 
of rewiring: (a), (b) or (c) and fixed value of noise e is applied plenty of times 
to achieve the stationary state. For the stationary state the magnetization and 
susceptibility are collected. The properties of the network are studied by the 
distribution of vertex degree. 

If the majority rule is considered at e = (deterministic rule) then properties 
of stationary state depends critically on the magnetization of the initial state, 
see jH]. It has been found that independently of L: 

• if r7i(0) < then the final state is all spins down configuration 

• if m(0) > then the final state is all spins up configuration 

Therefore one can say that the cellular automata perform, so-called, density 
task with high accuracy. 

3 Ferromagnetic phase transition 

Starting with all spin UP on the lattice with linear size L — 200 for each model 
of preferences, we apply the two-step dynamics: rewire an each edge with prob- 
ability p and apply the stochastic majority rule J^J for nearest-neighbors with 
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Figure 1 : Distribution of vertex degree in case of random rewiring for different 



noise e. After the stabilization time (here 5000 steps) we calculate magnetiza- 
tion and susceptibility of the stationary state during the next 5000 steps. 

3.1 Stochastic evolution of edges 

Gitterman showed analytically that in the small- world lattice, obtained from 
a 1-dimensional ring where edges are rewired with probability p and 2k nearest 
neighbors interact according to the Ising hamiltonian, the crossover temperature 
to the mean-field critical behavior varies for p « 1 as T{p) oc k{k + l)/ln(p), 
whereas the critical temperature scales as T{p) cx —2k/ln{p). So that a ferro- 
magnetic ordered phase exists for any finite p. 

A typical trajectory of the magnetization obtained for pure stochastic rewiring, 
at any p, shows the rapid change in the value of stationary magnetization when 
the temperature noise e grows. The plot in Figure ^ presents the characteristic 
of the network connections. The distribution of vertex degree is plotted on the 
log-scale to amplify its parabola-like shape. It means, that the exponential net- 
work is obtained due to this evolution. One should notice that the distribution 
is almost independent of p, namely, for p > 0.1 all curves collapse into the same 
distribution. 

The point of the critical change Scrit moves, see Figure El If there is no 
rewiring (the classic cellular automata) then the transition goes at about Scrit = 
0.14. If the lattice is rewired stochastically each time step then the transition 
point moves to 0.20 ±0.01 at p = 0.05, and to 0.22 at p = 0.90, see FigureEIleft 
panel). Hence with increasing rewiring homogeneous islands are more stable 
against the temperature noise. Moreover, the value of Scrit plotted against the 
log of rewiring probability p scales linearly (Figure [21 right panel)), what is in 
the full agreement with the property found in the Ising model on the small- world 
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noise s rewiring probabiiity p 

Figure 2: 

The points of phase transition Ecru for different p determined by the maximum in 
susceptibility (left panel) and Ecrit dependence on p (right panel). The stochastic 
rewiring case. 

network piTU]. 

3.2 Evolution of edges with preferences 

If the preferences (b) in edge rewiring are switched on then strong modi- 
fication to the network appears, see Figure l^tbottom) . The resuhs presented 
are collected for T = 8. If the evolution of a network is short (let us assume a 
hundred step evolution) then the distribution of vertex degree spreads up to 40. 
For p large the distribution function looks like being composed of two parts — 
the exponential part with rapid decay until the threshold value T, and the gaus- 
sian part with the mean value slowly moving to higher degree vertices. When 
study the phase transition one needs long run observations. What is recorded 
when the evolution is really long, the increase in number of isolated vertices 
is observed. The distribution presented on Figure |2| (bottom right)is obtained 
after 10000 steps. About 73% of nodes are isolated vertices. Therefore the mag- 
netization of the stationary state cannot depend on e, see Figure 13 for a typical 
trajectory of magnetization. 

Hence the phase transition is not observed — neither by change in the mag- 
netization value nor by a maximum in susceptibility. The majority rule does 
not have influence to the state of isolated nodes. However, the phase transition 
could be investigated if one ignores isolated nodes and concentrates on mag- 
netic properties of the connected component. Such a solution was proposed and 
applied by Herrero ^Dj in his study of the Ising system on static small-world 
network. But on the small-world network only small amount of vertices are 
0-degree, compare Figure Q^bottom panel). Therefore, in the case considered 
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here such approach is unjustified. 

3.3 Edges evolution with preferences and preserving con- 
nectivity demand 

To manage with increasing number of isolated nodes the additional condition 
is introduced — while rewiring, the graph must stay connected. Thanks to 
this demand the stationary networks present properties different from networks 
considered so far, see Figure 21 and 12 for details. 

Depending on the probability p the distribution of vertex degree shows the 
transition from an exponential network which is closely related to the initial 
regular lattice {p < 10~^) to an exponential network where vertex degrees are 
spread from one to one hundred (p — 1), by passing through the scale- free 
networks. Especially, when p is close to 0.1 the distribution is of power-law type 
and there are many vertices with degree greater than 500 on the network. 

The qualitative different magnetic properties are observed while p is changed. 
In particular, if p is small, i.e., p < 0.0001, then only few edges are rewired at 
each time step. Therefore the majority rule dynamics dominates over the net- 
work evolution and the magnetization and susceptibility are similar to those ob- 
served when stochastic rewiring is applied, compare Figure EJ^left panel). How- 
ever, the magnetization of the stationary system even at low temperature noise 
is only little different from zero. The permanently modified network amplifies 
the temperature noise making different temperatures almost indistinguishable. 
However the rapid change in the susceptibility ensures that the ferromagnetic 
phase transition takes place. The point of the change Scrit is located at higher 
values of the noise when p increases similarly to the property observed in case 
of stochastic rewiring. 

For large p, namely p > 0.01, the qualitative and quantitative change in the 
way which system arrives to the stationary state is observed. The stationarity 
is reached very quickly and the magnetization of the stationary state is higher 
than the magnetization observed for small p. This new feature is related to 
the fact that at the large p the network is self-organized to the completely 
different structure from the initial regular lattice. The network organization is 
as follows: there is a skeleton made of highly connected nodes and plenty of 
vertices of degree is one or two that are attached to the skeleton nodes. The 
spin state of any vertex from the skeleton settles the magnetization of plenty 
other vertices. Therefore, surprisingly, the point of transition Ecrit moves back 
to low temperature noise, seelSJbottom panel) — the transition takes place in 
the completely different system, namely, on the scale free network, compare |11|. 

4 Conclusion 

Stationary states of cellular automata with stochastic majority rule and net- 
work connections evolving have been investigated by simulations. Three types 
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Figure 3: 

Typical trajectory of magnetization at different temperature noise e : 0.02, . . . 0.30 
on the network rewired intentionally, p = 0.01 (upper panel). The threshold for 
preferences is T=8. Distribution of vortex degree obtained after 100 time steps (left 
bottom) and after 10000 steps (right bottom). 
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vertex degree 

Figure 4: 

Distribution of vertex degree in stationary states for different values of p, log- log plot. 

of rewiring edges were considered. The algorithm of Watts and Strogatz was ap- 
plied at each time step to establish the network evolving stochastically (the first 
network). The preference functions were chosen to amplify the role of strongly 
connected vertices (the second network). The additional demand to preserve 
graph connectivity has provided the third way of edge rewiring. Each of the pro- 
cesses listed above yielded the different network: small-world, scattered nodes 
and strongly connected component, scale-free network at the properly tuned 
rewiring, respectively. 

The stochastic majority rule applied to these evolving nc^tworks has driven 
the system to the ferromagnetic phase transition independently of rewiring in- 
tensity only if the network of first type was examined. A change of transition 
properties from the regular lattice to the mean-field characteristics was expected 
and was observed by us. The huge number of isolated nodes which were cre- 
ated due to the preferences introduced, made the thermodynamic investigations 
meaningless. 

Finally, in case of the third network some properties which are typical for the 
small- world transition were observed but only if the edge rewiring was of little 
intensity. However, while pure stochastic evolution of a network results weakly 
on the total magnetization, the preferences together with the connectivity con- 
dition yielded the efficient decrease in the magnetization of stationary state. 
The other transition, called scale-free ferromagnetic transition, was observed 
when the parameter p of rewiring was high enough. 
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Figure 5: 

Magnetization and susceptibility vs temperature noise e : 0.02, . . . 0.40 on the network 
rewired intentionally and with preserving connectivity for p = 0.00001, 0.0001, 0.001 - 
'classic' case (upper panel) and for p = 0.01,0.1, 1.0 (bottom panel). The threshold 
for preferences is T = 8. 
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The last result, namely emergence the scale- free transition needs deep in- 
vestigations. The observations should be verified in wide region of model pa- 
rameters to establish relations in quantitative way. On the other hand, some 
considerations should focus on the way in which the small-world transition is 
transfered into the scale- free transition. In particular, the mechanism in which 
the hubs ( — widely used name for highly connected nodes) influence the ferro- 
magnetic properties should be clarified. 

Let us close with the following remark. Network evolution rules considered 
here followed investigations done in the Ising system and therefore were far 
from the basic idea of cellular automata design locality. There is a need and 
necessity to include one more condition to the network rule that any rewired 
edge can be attached only to the node chosen from a list of neighboring nodes. 
Such simulations are run and raw results are promising. 
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